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Abttfj L \t 

ThE WumpUi Advpjor program offer* ad Vice !c a, player involved m choosing- the best 
move in a game for which competence in dealing wish incomplete and uncertain knowledge 
is required The desjgn and implementation of the advisor explore* a new paradj£rr> In 
Computer Assisted Instruction, in which (he performance 01" compuler- based tutor* is 
greatly Improved through the application of Artificial Intelligence techniques. Thu report 
dewlbtt the design of the Advisor and on Ml net directions for further wmk Our 
experience with th* tutor if Informal and psychological experimentation remimt to be done. 
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I. Introduc tion 

The Wumpus Advisor grew out of a courje we gave in EduciEiunai Technolnjjy Co a 
small group of graduate and undergraduate students «M[T. Our goal was lb explore- a 
new paradigm in Computer Aided Instruction, in which tke competence of computer-based 
tutors IS greatly improved by applying Artificial Intelligence technique*. ED their design. We 
particularly wished to study (he structure of Intelligent Computer Aided Instruction {ICAIJ 
programs that incorporate an Eapejt module which allows the tutor to compare- lh* 
studem'i response to those generated by the expert, In using the term ICAl and exploring 
the consequences for a tutorial program nf the availability of an expert modufc. we folio* 
the lead of John Brown, (Brown and Burton I9"?5>. who has shown In his design of 
sophisticated instructional environments for electronic^ the promise of this approach. 

In order to experiment; with this paradigm, an TCAI program for a simple game was 
Implemented as a course project. The program serves as an AdMisbr to a player, offering 
advice and analyst a< appropriate Utah. We chose WumpUS, a maze-exploration game. 
because ir represented the nest step in complexity beyond the tutor designed by Burron & 
Brown for West, a simple game or the Plato system for exercising arithmetic skills {BtlrlOn 
1976). Wumpus is motivating and require a farietp of skills covering planning, plausible 
reasoning, decision theory and Incomplete and uncertain knowledge 

The Wumpus Advisor was successfully implemented by the students in ih« course 
under Stanifiekfs supervision. The program was later improved and extended by Carr H 
who is continuing to work on the project. This paper describes ihe current staie of the 



program which gives appropriate advice in English ibout the logic involved in choosing a 
best move. Four difTcrent levels of student are catered For but other than this broad 
distinction there Is little student modelling. Thb aspect of the research is currency being 
developed. 

By studying simple teaching situations and modeling them with program* thai teach 
we gain insight into the processes Underlying learning and teaching. The rich metaphors 
of computer programming help Us to describe- teaching and learning precispfy and in detail 
while the discipline imposed by requiring a. worlang prograHn weeds our impraeiieal Ideas 
and points the way to better ones. 

CA.I programs need models oF situations and students iF they are to understand what 
is going on and act appropriately. We must provide them with piatrical procedures for 
making decisions about teaching and give them a precisely formulated knowledge of their 
sub ject matter so that they can interpret, n»od#l and act 111 a variety of teaching Situations. 
They a bo need an expressive means of cdmmunlcation such as natural language, display 
screens and tablets for both interpreting the students behaviour and making effective 
responses. 

Many early teaching programs and some current ones were "fact dispensing" 
machines. They used the "empty bucket" theory of learning, a trivial one in which the 
learner ii simply a receptacle to be filled with facts. Although this theru-y may be decorated 
wtth extra rule* to present facts in special orders or In dusters, il k very naive and hardly 
tayi anything at all about real learning. The key CMnpLllihg concept which it excludes, is, 
that of a process. The student should above alF else be learning how to do something and 



shouM hr participating in various activities toward that end. Hr is programming himself 
with the teachm assistance. By changing the paradigm from facts to procedures the whole 
enterprise is greally enriched. 

From Ehis viewpoint we. are forced to smlysr ihe student 1 ! laming task and cornpri; 
this with his behaviour, It becomes important to natlce and correct the things he dcH's 
wrong, forgets, lo da, does unnecessarily ni dops In the wrong order Many ideas from 
Computer Science are Of great significant to this. The student's task can be modubrly 
decomposed Into tub [asks with Individual goals. These subtasks can be organised as 
processes, coroutines or sreps. in a procedure. The vocabulary of Computer Science ii rich 
in precise concept!, for describing this. Similarly, his org a morion of information and 
methods must be examined and debugged There are sufficient partially-formulated 
concepti Jn AI that deal with perception, natural reasoning, organising knowledge, pknning 
and so on, for new descriptions to be made of the learning and teaching process. 

The Wumpuj Advisor develops the application of computer* in education. It US the 
firit version of a program which helps a student to learn a simple game catlrd Wumpuj 
{Yob 1955). Acting as an interface between the student and Che game, ir internes 
whenever the Student's moves show that he needs advice. Advice is given as Fnfjhsh 
discourse explaining in full the merits and faults of particular moves. Wumpus is prVycd 
In a network Of tunnels whose connections are initially unknown to Lhe player. He must 
search this network avoiding dangers and frying; to find and kill the dangerous and deadly 
Wumpu;. Throughout play the advisor gives the student information about his immediate 
locality and evidence about nearby dingers. From Ibis infuTHUtlcn it is possible to mf*ke 



plausible Inferences and judgements which aid lit avoiding dangers. Trie game is highly 
motivating to children und emc-lws several types of reasoning skill. 

The gam* paradigm for advisor* has also been researched by Burton using the game 
West (Burton and Drown V^flb). Wumpus is a mure complex game and Js a natural next 
step. In general, games form ffifffllfcnt suhject matter fat id vice giving. They are varied, 
provide motivation, and exist at many degrees of difficulty. Some, such as chess, have 
targe bodies of advice associated With them in the literature. Games are often models of 
real-woifd situations and develop abilities that are useful in everyday life. Many of the 
strategies involved in the game of On are of this nature. 

There ate five good reasons for using a simple gam? as the domx^ci of an advice- 
giving program. 

p 

1. Closure 

The rules are dearly defined. Since it is easy to describe what constitutes a legal move the 

student can always be expected to play within the rufcs even if he plays badly. This means 
that the advisor will be able to make sense of his inputs. With a less bounded domain It it 
easy for breaks in communication to occur because the program cannot understand the 
student. 

2. Expertise 

We can easily design an espert player for many simple but interesting games. An expert 
gives a precise procedural theory of Che domain which we aim to tfach. 



3. Homogeneity 

For Simple games the same theory of good play applie? *t each move. The rules that the 

expert U«! are good *l til itages or the game This gives generally to the teaching 

situation. A skill kl be L rtg taught whbch is exemplified in diffetent ways throngbotil the 

game 

4 Simplicity 

It is eajy to find simple examples of game* well within programming capability. 

5. Motivation 

The undent is motivated by a game when he may not be by traditional curricula r domains 

These properties make it my to sustain an interaction between ibe student and the 
teacher. Even with no advkc-giving at all. the game scenario provides a continuing 
exchange, In a sense ibis is cheating Tor It flakes it easy to write a "toy" program but ihe 
important point it that we can Mart from such a position and enhance the advLce givmg 
step by step. This is the way people learn games in any ca«, beginning with (be rtllcs and 
accumulating strategies which cover progressively more situation! 

Our general methodology was to find a. domain which the computer can deal with 
easily, which requires only simple inputs hut which has a large set oF states. Games Til this 
well Electronics does too as Sophie, ibr electronics advJnng program (Btdm and Burton 
1975}. shows Sophie helps * Student learn how to repair a Faulty electronic circuit. A faulty 
circuit can be simulated. Moves correspond to mea.su renwnis or alteiahons and. though 
there are only a few move typ«> the possible hypotheses that can be made about a faulty 



Circuit are n umerous and varied. Domains We geography or history ire hard lO Utf in a 
GAl program, They are very knowledge -oriented and (end nut to he elowd. Limited and 
welhitructured aspects oF them must be Uifd if the domain l* not «o expand continually or 
the student: is not to overreach the prograrVs knowledge (see Collm? (9T5 for promising 
work in this direct Ion} 

A simple game like WumpUi nuke* the task of writing *n advisor manageable but 
docs not ex dud* important feature! of the teaching process. Models of (he student. ways of 
using them to provide relevant adv|ce h questions of motivation and of not ovrrad vising-. 
can all be studied even F°r & simple game. We have not programmed any student 
modeling (aciiuy yet in our advisor though the work we have completed is a preparatory 
Step 

Th* student Is doing several things when he plays WtlmpUS with the advisor First, 
he II learning how to play Wumpus. An adaptation of the program could also IttKh him 
variations and perhaps entirely differew types of game. By learning" Wumpus he learns 
Certain reasoning and planning methods These are Of various types which we summarize 
shortly. At a more general level, the stucten'. is learning how to approach new games and 
what methods are appropriate for unravelling the consequences of a given set of ruk?s. 
This ii not restricted to games. There are more general situations with logical properties 
and rules and he might be developing a skill in producing effective procedures for acting 
in thes* situations. When first in a new situation une roust direct the moH resources 
towards an understanding of the situation. As skill accumulates, fewer resources are ne*ded 
and evEncually tuning up and debugging is only done rarely. This is a general property of 
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skill acquisition. (SeeSussman J^3, far a computer model of this kind of truing.) 

The correspond ing aim or an advisor is to help thr student learn how [a do all this. 
Our current Wurrtpus Advisor flfiljr advise* oil particular polnis of play jo rhe Student will 
only bu,|d up general sk.llt indirectly. LtWr> we desert *n approach th*t tan be taker, to 
►improve the Wumpus advisor and consider decision malting 4kMs in more general ttr 
ihowing how the Advisor might (reach these. 

There appear to be several different styles of playing and thinking »houl Wump 
People bring a variety oF altitudes 10 the game. Some play very safely while of hers play 
with abandon for th* Tun of taking risks. Those who- approach the |ame from the point 
Of View of its logical Structure are more likely to learn efficient play ] fl a shorter lime than 
these who neglea this structure. Or* the basis of informal observations, they appear to 
quickly absorb and benefit from the current program's style of sdvke. Players who lh . ibr 
game from other viewpoints might also benefit from our advisor's analytic approach which 
can be general I ?ed widely to tuber domains. However, the current advisor does not give the 
gradual and sensitive advice about logical rules which must be provided for a sludenl 
whose manner of play Ls different from its own. Again, on the basis of informal 
observations, we find that such subjects ignore long technical advice, because it Spoils the 
fun of the; game. A more appropriate advisor would understand their motivation! and 
treat the logical aspect as only One Of several. This is an area which deserves rnniirie ruble 
research. 



1-2 A nalytlcal and Synthetic approaches to learning garnet. 

When a student Is given the rules of Wumpus he must flrit analyse them to 
determine iheir implications. There ire several way? he can do this. Firstly he can 
experiment, playing a variety of possibly risky moves until he empirically determines the 
regularities. In complex situations experimentation is combined with induction to generale 
and test hypot heirs. A more dim? method of analysis uses logic 10 infer properties of" the 
game so that strategic can be developed to take advantage of these properties. This is 
very clearly Illustrated in Wumpus, The player knows some hut not all of the state of the 
board at any time. He can analyse the laws of the game and can develop about one dozen 
precise rules of inference that he tan use to help locate the Wumpujand avoid dangers 
He must embody these rules in a procedure for analysing a board situation and must use 
synthetic principles to do this The Advisor contains an espcrt VVumpus player which has. 
all of these rules already available ro it. When relevant, it points out examples of the rules 
to help the player make his move. The player is made to consider the corresponding rule 
and incorporate It into his play. 

Techniques of synthesis arc used to construct programs and plans. Goldstein 
(Goldstein and Miller. 19%} describes a classification scheme for plans in the context of 
Logo program writing. Typical examples are linear plan h recursive pfan and parallel pton 
Acquiring skill at Wumpus can be seen as synthesiiing a set oF programs, w different 
synthesis technique; lead lo different Wumpus playing strategies Many problems are 
encountered when assembling separate pieces of advice into a coherent stralcgy Some rules 
have preconditions and may only be invoked in certain situations. A strategy which only 



applies in Wrtaln circumstances will otherwise give rise to bad play. It Is useful to explain 
erron jn the student's model of play in terms of debugging and recognisable bug type*. 
The student may then learn to recognise bug types himself and gradually build up a 
repertoire of repair techniques. 

1,3- Methods appropria t e <p Wurrirjus 

Besides general techniques of synthesis and analysis there are those nhich are 

associated wiLKi particular domain!. Wumpus Lmludes two types of I no*. ledge omJIted from 
previous teaching programs. These are incomplete and Uhcerta in kviowkdtjr. A Wmnpus 
player Usually knows only a portion of the board and must develop procedures which can 
act effectively under these condirjcni Three general methods; decision theory, probability 
theory, and planning are useful techniques for this type of ^nation. 

I. Planning. 

To play a gam* well one bas to plan and should learn to avoid certain planning bugs, such 

ai planning too far ahead or too unevenly. There are often good reasons for choosing a 

few candidate moves and restricting roohahead only to these. AI has a considerable body 

of knowledge abCKJT planning In various domains and these principles should be Caught by 

a good advisor. 

g._ Decision Theory. 

Because Wumpus involves uncertainty and most moves bavc a combination of valuable- 

and dangerous outcomes we can well apply the decision theory paradigm which n useful in 



many more general situation*. This theury shows how to assign values and COMS to 
properties of outcome? *nd gives a *ay of comparing these utilities when the outcomes 
OCCUT With calculable probabilities. It incorporate! 1 bar>Up algorithm that combine* 

planning wiC.fi evaluating particular states. 

3. Probability. 

In any Uncertain situation probabilistic heuristics may be used to advantage Estimating 

the probabilities of death at each move is crucial 10 good Wumpus play and our program 

uses qualitative probabilistic teas wing in its expert player and for giving advice. 

1,4 The rule s o t Wumfm*- 

Wumpirs is. played by one player, a Wumpus hunter, in a world consisting of a 
number of cavei connected by tunnels. The player moves around this warren trying; to 
avoid danger* and with the goal of finding and shorting the Wumpus. Initially ihe hunter 
only know* the structure of the warren n-mi"ii.t ■?',■, .irnund him. He Vnows the number of 
the cave he Is in and of all caves directly connected to him by tunnels. Every time he 
makes a move* which must be into * neighboring cave, he is told the cave -numbers 
neighboring his new cave. The danger* of the warren arc pits, bats and the Wumj>U* 
which, liVe the player, are initially rotated at random in the warren. Any move into a cave 
containing a pit or I he Wumpus results in instant death. If the player moves into a bat 
cave he 13 earned away by the b^S and dropped into a random cave which may of course 
contain danger. Bats are not fast enough to save the player from pits or the Wumpus if he 
inadvertently wanders into a cave containing both bats and one or these hazards. They do 



«rry the player away before he gets a chance to see what the neighbors of ihe bat cave are 
though. There are dues which help in abiding the haiardi. The player hears squeaking 
if he is one cave away from a twt and he car, fed a breew if he is on* away from ■ pit. 
He car also smcfl the stench of the WumpUs From up [0 two caves a way but cannot tell the 
distance dimity. None of this evidence tells the player the diction of a haiard The 
hunter has a how and five arrows which he an fire at any lime into a neighboring «Ve. 
The arrow will ricochet at random through the warren for up to a distance of flu? caves. 
and will kill the Wumpus if he is hit. It is passible that the mow will by chance find lit 
way back and \m the hunter. A typical warren will conlnin 20 cave? J bais, 3 pjtj. (he 
player and the Wumpn* 

ISA Wumpus Scenario 

The student's input Is, In bold type the computer's output is in italic* For the sake or 
readability we have taken the liberty of ed-irin^ the advlwr's outpui by, for example. using 
pronoun* to refer to caves that have already been mentioned. We could easily update the 
program to effect most of these changes itself In the case of pronoun reference* 
Wnograil's program fWi^ograd 1973) provides methods that are suffjerwrt for the limned 
examples in this scenario. 

Hello ha. / tttjBit art a btffming player. You ham had J aiifij and ? lotset Let's hrgiti. 

Yen arc at cav* if wit* lutgAbort 4, t4 r 0, onrf 8. Rtnr.' I fed a draft. Yen ate mar a pit 
What a ninth. 1 mill iht Wamfiiif What now? 




If 






*tfr 



6 



1 tulsk you Itttk. Yo\i an at tati* 4 ntlth ntlghbws cants 14, 6, 2 r and 15 Brjnf Squtak-f 4 
bat is near. What nam? 



H 



This is « dttngtrvtis mwt. Vpu- havt frrra in tvm nei%hif&n of H and jeti- felt a d^a/f in IwtA. 
This is daublt tiridtnct la tl is probable fAsr a pit is thert. What 7\ow? 



Advice 



Cav< 8 is a btittr cttvt it txptin. What n*wT 



Why 



T*trt ^ n<? dangtrfrem tht Wvmpm <tt 14 or B. It H ptttibl* that 8 an^inj a pit but u it 
mart ti^th that thtrt is Otii Hi f4. Wfai tifrnlP 



You an at cave S with mighbw} 19, J, 1} and 9. IP fata tttnthf Whot Ww f 



f 



ty 



s 



J9 



B 



/ 



°w-~ - 








11 



Vm atr al cav* 19 with ntighf^j [7 t 8. and 6. StftuaV What iWte} 



Thlt tt a good ww, ha. iim« it is m it} waf to the soft caves I and 9. Vqu are at taut 8 

ail A nttghbets I? p ?. U and 9, What a tttttM What r\$ttf 




Ytnt are of cave 1 aiith Heighten 12> 8 r and 9. What a ittnchf Wh*l ijpm* 



\7 



That Is a ft iky m&ft- Tht W\impui could be in 52 because you haven't found any iQvts tknt 

art within tw< ran*j of 12 thu te<n mtttfrtt. What n^>7 



AdvioT 



You should zisit alt tht eaves mteth you. kntm me soft before you sifftt taking Whs. Cave 9 a 
a gpod cave la explore. (JLke 12 it if free from bats and pits; however, tht Wumpui can rutt he 
at «w 9. What no** 



More 



if the Wampus were at cave 9, then case 8 would be next to him and you. mould smell him at 
cave 19, But, you didn't melt Aim at «w Jfl, so 9 is mft. What nm* 




lO 7 

You are it C&V4 9ivith ntighhis S r 7, W r and /. What a stench! What tmbu*' 



Hrlp 



/ rent give you information about ivhtrt you are, where yo\i have bten, and tuhat you. have 
learned at rath cave that you. havt visited, i can also give ^ou advice. What nota* 



AdMee 



Cave 1Q tu good (w to txpiort. ft n faiMt that the Ww*p*t i, in uvt 10, but that 
nwtsiaTj riik. There are no safer covet. Who! ra&w* 



',:• a 



10 




& 5 M 



Vnt are at cave Iff vitA Heighten It, 9, 1, and 2. Brrrrf Whal a ftenehf What mm* 
II 

it ii poiitbtt that cave 1} antcijti a pit. WttoM you. fib to go ahead With that mwt* 

No 
What now? 



Ym Mtijjjf £> dltectly to cm 7 from cavt Iff Wcuid you like a route If tavt 7T 
V« 

Go H 9 surf thtti. to 7, Shall t make the mafftif 



You art of taut 9 with neighbors It, &, 9. and SS. Wh&S tientf 



You are at cave 9 with Aeighbfftt 8, 7 t 10, &nd S. What a. lUnch* What now? 




You art at cave I euIIA nelghbcri 12, 3, unit 9. WAai a ittTwht What Ft™? 

it 

Thai is afalai movt. vVeuld you like advice? 

y« 



The Wumpm It thtrt- by thf fntlonilng wgumtnt: 

Cavt 8 nuit be exact!? tm away from tAt Wumpiit time it smelh atd tavt 19 doesn't. This 
xtfftm that either cave }, ft or fl must %t next it Aim. 

Cavt If a two away since it is nt*t It 4 which doun'l wwit. Cam 9 ts.ii t om <lwav since you 
Vlilttd €Sve 7 and that didn't tmttl. Thertfort, 63 elimination, e$Vt 1 is cm away. Htncc, 
one of Us H4tghhcrs must be the Wwttptil. 

TAt Jitig Abers cf 1 art S. 9 and 12- You tew visited S and 9 w t H climmatim . tht Wumpus 
is at 12. 

Shoot 

Whith c#ye would yon like to sftttit into* 

12 

Congratulations yon. Adiw shot tAt Wumpitlf 



$. Thr struct j re of I he idvlsar. 

2 1 Major ca pabilities 

The WumpUS Adviser has several capabilities organised around in expert Wumpus 
player that embodies a consldetabk amount of knowledge about the fame. This expert can 
evaluate the student 1 ! move, compare it against the best move and explain differences SO 
that the student will Improve h.ti game. Future versions will 1ndu.de a model of the student 
m% * perttifbariWl Of the eKpen This wiH increase sensitivity to the particular problems 
facing each student of the game. En this section we outline the stmctufe of the expert, its 
capabilities, its basic method of deduction and "t? advising and explaining Strategies. 
Section 3 cover* the detail* Of each Of these topics, and section 4 outlines an improved 
approach developed by criticising our present effort 

Our expert Wumpui player has four major capabilities 

L It deduces Information about the state or the game from what it It now* the player 
knows. 

2. rt can evaluate any move that the player can make. 

3. It clasiifies »l\ moves according to a set of calcgones designed to capture the major 

strategies of Wumpus playing. 

4. It* evaluation of & move is modular. 

At any time In a Wufnpu* game the prayer can see a small portion nf toe warren and 



can remember areas he has visned or ha* seen front a visited cave. He has partial 

knowledge of the warren from ibis mFormatiori. He car. use his memory Of the iDCMlon of 
bati He has come across and all the evidence from smell*, breezes and squeaks Chat he has 
discovered in the MUrsc of the game. A good player should br able to deduce Useful 
information about the position of vinous hazards by combining this iniotmatrun and 
usln* inference rules entailed by the rule, of the game. The expert makes most of these 
deductions, only Using information the student knows or ought to ha*c remembered. In 
time; the advisor teaches the student to make ill of these deductions himself m a readable 
manner and to use the information disepvewd to make a best play. There are two broad 
Classes of information our expert, can deduce. First, It can often determine exactly the 
positions Of a bat, pit or [Tie Wumpus, or can teH thai a cave |j definitely free of such 
hazards. This .s clearly important to good pray for hazards must b* averted and safe 
cavei are worth Investigating, S KD r.d, and Very important in uncertain and incomplete 
situations where definite facts are unavailable, the expert can evaluate probabilities of 
hazards for any particular cave. Various heuristics are used for this and they represent 
qualitative fcnewfcdge abcui using evidence to nuke decisions 

Inforrmrlon gathered by these techniques is then used by the expert to evaluate each 
possible move- All moves are treated independent^ There is no need to plan ahead In 
detail since a move can almost always be mad* at anT time If at all. Only when a bat 
transfers a player to a remote part of (he *arren do caves become inaccessible Ev*n in ihis 
case the warren 1 1 SO interconnected that It is unlikely to be much of a handicap A move 
evaluation consists of a probability assignment for each hazard type and a simple- 



measure 



of the information thar would be gained by the move. So cave 3 may hive a O.i 

probability of a pit, a ceils in bat and dcMniicly no Wumpus. Il may be near the Wumpus 
and so be likely? to give information about it. 

The expert has an executive which classif its all passible moves according to a seven 
point seal* of goodness shown in figure I and discussed in detail in .section 3.4. Each 
category ji a distinct type. Safe moves are preferred to unsafe ones and given two moves 
of roughly equal safety, Ihe otto which reveals most information about the warren and the 
Wumpus is regarded as the best. Ah moves in the fringe area are considered. These are 
caves which are aeceiUbie out have not yet been visited. It is a waste of rime to visit a cave 
that has already been vuited unless it Is on the way to another profitable cave in the 
fringe. If the player does visit such a cave it is assumed he is going somewhere valuable 
Unless he wastes too much time by goinp in p refilled circles. 

The expert Is composed of four majn units, an executive and three specialist^ one 
each for bats, pits and the Wumpus. Naturally, from the symmetry of the game, the hats 
and pits expert are very similar and use similar deduction rules. Each specialist deduces 
what it can about its associated haurd and reports to the executive Modularity allows for 
a comprehensible expert which Ls a natural advantage for teaching purposes. The student's 
play can be evaluated separately for each speciality and a bo on their integration. We 
expect that this will make it easier to construcL s'.udenl models. It certainly allows the 
current advisor to advise about one particular module at a time. 
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Bat-pit safety has beer given precedence The da 1 9/p. r t n value of a cave- is 
the probability of death by bat? or p i Is irv thai cive. The Uymbus value is 
1 If the cava is safe from the Uuropus but Mill give i n f or ma < i on about it, 2 
if it le safe but Hill give no information, and 3 if it is unsafe. 



figure 1. 



2.2 Ext r a facilities 

Several extra fjulHtiel have twrn added to the basic expert outlined above They can 
be thought of as extra modules although thty do not relate to the executive in the same 
clear way as the three hazard modules. All three, of the facilities we next describe could be 
improved greatly and integrated into the advisoi moic cleanly. 

We Include a simple help ipenaltil which will offer thf Jiudent a good move when 
he is In trouble and will also present an explanation of It If the Student desires. It is almost 
entirely a call to the expert fat (he current best move. We make no Attempt to supply a. 
move which is tailored to the Students current difficulties. ThH enhancement will only be 
reasonable when student modelling is implemented. 

Since the playeT may not remember all of the warren he has dome across so far, we 
provide a route finder tptcialiii. If he has any difficulty in reaching a foal suggested by 
the move suggester the advisor will offer a route through known «Fe caves. This is 
coupled with * help facility which gives the player information about any cave he has 
vjjited on request. 

More important and most in need of further development is the Lfrnting Jpteiafist 
whose job it is to prevent the pfcayer from wasting arrows and to ad rue him to shoot if he 
should be able to deduce the exact location of the Wumpus. It will dissuade the player 
finrn ihuotthig if Tie has not located the- Wumpus esactly or if he shows into a cave that 
toultt not be the Wumpus, eipecialtjf If there are other worthwhile things to be done. 
Future shooting specialists ought to weigh up the risks of shooting, the value of the arrow, 
the possibility of hitting the Wumpus and the availability of good plays elsewhere. We 
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return to this when we consider a decision theory paradigm for f ULurc Wumpus advisors. 

2J The advising paradigm 

The advising farad igm foF our current program is a simple one, This is twcausP we 
do not y« have a componeni which EFfecclvely makes models of the student. Our system 
describes hits, immediate behaviour and not the reasoning thar led him to I his As a 
consequence, the ad vim will advise when the student makes any ncn-optlrthd move and 
will give him a. description of hi* bad play which is Usually too full Nevertheless, there are 
some SUbfJetics involved even using 1 our simple techniques. 

While discussing the expert we noted that the executive classifies (he student's, move 
ar..;ordlri£ to a seven point set of cafc-goJies fsre figure I). We associate, a program callrd a 
move-tvpe-inilyjr with each type in this category set. The Job or such art analyst is to 
comment whenever the Student makes a move of that part leu rar type. Each analyst will 
Check to see il" rhe Student made a move that w as significantly worse than the besi possible 
before it criticises, him. The conditions for this vary according to The parlicular type and 
this || one reason for having separate analytic hi general the best moves are the ones wnh 
the lowest classification numbers and a drop gf are makes a significant diff errnce. This is 
not always the case, for sample mnvc-classif if inor* i Unsafe because of bats or pits but 
safe from the Wumpus while giving information about it) is not always significantly wosse 
than crass 3 (lafe from bats and pits hut in danger from !be Wumpus) even though in 
general a drop of one Crass does male * Significant different.? 

The comments made to the -Student depend on nniv< types as well as on the particular 



board state. Firstly, the analyst commenls on the move type 11l*M Vfitb some statement such 
as "that is a rlsly move". Of course if there Is rib Safe move it will say "good luck" and 
leave the player to riis fat* but often more specific comment is needed. There are two types 
of bid feaCure a move may have, those thai art avoidable and those That are not The 
analyst only Comments on the avoidable ones, a proper ty ubich depend* on the better move* 
available at the time. If the avoidable danger was a bflt haiard the bats espert would be 
called I r* (O give an exportation of the hazaTd. The implicit assumption is that the student 
did not see it. With a good student model we could distinguish between this and the case 
when the player noticed The hSLUird but failed to see any better move The advisor focuses 
the player's attention and stimulates him into finding a better move by rearing to (he 
huard as a reason fur noL making the move he fried. It is alio possible that the student 
Found Other moves which were free, from the Criticism but noticed faults m these that he 
*as mistaken about or (hat he gave too much weight to. A good modeller should allow us 
to adapt advice- giving to f»Jes like this 

Having Criticised the player's move the analyst allows him to think fot * while by 
asking him if he wishes to go ahead. The player can change his move and will then be 
offered a better one. On request from the player the analyst will compare Its suggestion 
with the- player's move The explanation is comparative so no common feature* of the two 
moves need mention Ifig. 

We have summarised that part of the advisor that currently fits nicely into a 
framework. Throughout the program arc nuroeTous patches thai improve advice giving in 
ad hoc way*, Examples of such special cases are, advising about shooting, commenting on 



FepMted mistake; and cautioning a b quit fLme wasting by mowing Only into viiited caves. 
We hop* eventually to include thej* In «ir theory. 

2 4 SenjiUiyilr io itig studen t 

Although na student modelling Ls dane by the current verston of the system chef* art 
two comment* W be made about the •**</ the program deals with the itsUe. First, some 
adaptation to student performance h-vels is made e*cn without active modelling. The 
Student is asfced to rat* himself on a four point scale of WumpUs hunting ability It would 
be fairly e**y to hare the program actively make such coarse judgement over ji period of a 
few games. The fating influences the advisor behaviour in three ways 

a J provision for initial Jdvjce, 

b) pruning explanations. 

c) pruning the expert'* deductions. 

If the ptayer is a raw beginner there are certain features or (he game he might not 
have realised. For eicamplc, bats are not as dangerous as pits since they usually land you in 
a safe nave. Immediate observation* such as these are told perhaps once or tw|« to a 
beginner and are not mentioned again. 

The program can generate detailed explanations by tracing through the deduction* 
made by the expert in determining juch fads as probabilities of bats. It is useful TO ptun* 
this advice leaving onlf relevant Facts. The two most general approaches involve 



technique* ngt yet Included Ln our advisor. One Involves natural language dialogue. If (he 
Student were able to ask (be program* Cor detailed eKplanailons when he needed them, rhe 
advisor could explain in a mpdown fashion, beginning with the mam steps of the 
deductions and awaiting prompting Fen particular SUbsteps. It is possible to allow sonw 
f arm or prompting without a natural language capability if for each lower level «ep the 
advisor asks the student whether he needs an escplanation. 

K second method require* a good Student model to determine what the player already 
Vnows. We Incorporaie a coarse version of this procedure. The student is asled to describe 
hki level of play as a number From [ to 4 The difference between a very good player and a 
novice is enough to jisMFy omm^fting explanations of simple step* when ad v lung (he good 
player. Though rhij does not solve the problem or over ^helming a beginner with detail, it 
does improve the situation for a good player, 

Finally, we assume that one who claims to be only a moderate player will not mate 
any of the more sophisticated deductions or probability judgements that our expert can 
mate. In this case we remove the relevant deduction rules from the expm to bring n more 
to the leuel of the player This can be repressed ns, "regardless of the student he must 
Irarn to walk before he runs*. Because oF the modularity of the rules we can male this 
adjustment easily. The same property should aid us in designing a realistic student 
modeller in the fuhjre When carried through this |«ads (0 the notion oF a "syllabus" winch 
is an organisation of (he teaching material that provides guidance for deciding In what 
order the material should be presented. 



Most moves in a game of Wumpus yield information *hich may be used as evidence 
for locating and evaluating danger* On [he board. We describe (he detailed deduction 
procedure! u»ed for doing this in section % but ic is worthwhile to make some general 
observations about the deduction paradigm we used. We use four main headings for utir 
description:. 

I) An assertions data bast, 

■J) Antecedent theorems, 

3} Special representation of diSjlJi-Klicms, 

4} Mathematical functions for evaluating probabilities. 

The assertion*) dau base contains informsiiOn representing the state of thr warren 
When It IS set Up. It includes the connections between cavei and the eJtact locations of the 
player and the hazards. Initially, the player knows nothing about the hazards so we 
distinguish properties and relations which describe his changing view of the world as the 
game progresses From the actual State of the world. The. expert, oF course, plays f iom ihe 
players point of view although it is conceivable thai future programs with more 
sophisticated advising methods will "cheat* xnd help the player avoid difficulties he is 
unprepared Co Face. There are two types of properties and relations. One set of properties 
ti a primary let including such properties as 5MELL, VlSlTLt), etc It is assumed that any 
player will have these as part of his Vocabulary jjnee they ire so closely tied to the way m 



which the rules of the game are presented lo (urn. Other properties,, such a s 1-AWAY, £- 
AWAV, are more remote, Tbrjf appeared useful to us as we designed an expert. It is 
Important to note thai the student might not hive thrsc in his vocabulary until the advisor 
shows him that they are useful. Left to himself he could come up w|jh X leially different 
fepfHfflMlkOfY for his play We assume thai there is only cine good strategy and all J he 
program's, explanations are phrased in terms of the vocabulary needed for trie inferences 
involved in this. The hope is to set the student thinking along (he same lines. It is- 
Important far Future wort to remember that different people may represent problems 
differently so that a better advisor must be able tn determine a studenl's representation and 
model him accordingly. In Wumpus type situations it may he important f Of the advisor tr> 
see- how the Student represent! the wirten diagrarnatfcally though, in general, multiple 
representations poses a very difficult question. To xummanw,. our program use* a Single 
predesigned representation and attempt* 10 impose thliOfl ibe player. 

Wumpus. is a sufficiently simple game that antecedent methods can he used 10 Veep 
tract of new deductions. Whenever any new mforrriailon appears the expert draws all 
implication J It ever will between this and the old. information. Thus we capture one aspe-cr 
of a game player. He has a, view or the game state which slowly changes as, new 
Information interacts with it. The espert has tbeomms which determine features of caves 
such as being one cave away from the wumpus, hfjng .safe, or containing the Wumpus. 
Some of these ire simple, for example the condition that an arrow misses the Wumpus 
would trigger a theorem to assert that (be cave I he arrow was fired into is safe. Other 
theorems have several possible triggering conditions because a feature of a cave can 



depend upon features of ill its neig fibers. |t a hi? happens ttiaL a theorem may be triggered 
to prove a property already known to be true. In order to prevent unnecessary chain 
^tactions of triggering an antecedent theorem always ctiMkJ first lo see if its result is true 
already, 

Theie design fealur tj art toanrrwft knowlntgt to Al prftgrwoitT i bul fake an a Tieni 
light in an advice giving program. Tfcty attftatuttt which muld improve a player's 
game if hi crga-TUjerf his hnowtcdgt by ilm 

When the expert deals with bat and. prt inferences it is interested in the probable 
location* Of bats and pits. This requires it to represent disjunctions such as "there must be 
a bat. in cave I, % or 3". We were led io use a special representation m terms of eandiibitt 
seti. In the example just ^iven there would be a candidate set of (carel cave? caveS). Bats 
and pits deduction procedures were dejjg ned around this notation and manipulated using 
intersection, siie and let Ificluiton. 

Evaluating the likelihood of a bat fur any particular cave differ! ftotffl the logical 
deduction process used lo find the exact features of <ives since it involves probability. It is 
extremely hard and mesjy to apply probability theory exactly to the Wumpus situation AH 
probabilities are conditional on the partial Information already accrued at the particular 
itage of the game. This leads to complex formulae at best and exhaustive combinatorial 
search ai worst. Our espert is Instead a model of heuristic and approximate probabilistic 
reasoning of the kind that \ now led gable game players use in common sense judgenwnts 
about the game. We determined four general methods that might well be used to estimate 
probabilities and adjustment the results to account for multiple evidentr and the 



phenomenon of evidence being explained away. Our rules embody simplifying 
assumptions- and at* generally Useful outsJde of Wumpus, Though we expect that mtwt 
students will use some qualitative analogue of our rules, the advisor represents them u 

mathematical formulae embodied in procedural. This has a quantitative nature which 
makes verbal advice hard tD give. The advljor overcomes ihis partially by pointing oui the 
evidence Jt use* as data for its formulae and thrn saying thar the Student should, deduce it 
i$ likely ■(probable,, etc) that the cave in rjursiiurr contains a hazard. We don 1 ! yet know how 
much advice givtng abour common sense reasoning can be ha«d on 4 quantitative modEl. 

7$ Generati on of explanations 

The Wumpu* advisor gives detailed explanations or Its reasoning. This tads the 
student re deduce useful properties of the board position and to Use them when deciding on 
an appropriate move. Explanations are produced in a very simple wav similai to that used 
In SUnsfield (1975). An explanation bears an almost isomorphic relationship to ihc 
deduction procedure that is t>eing explained. Each general rule of infetente is associated 
With an explanation function. If the rule is of the form "A and B implies C~. the 
explanation function prints out an explanation of the basic form "C because A and B" 
Since rules may tw applied in many cases, many explanations can be produced by the same 
explanation function. TMi Is only the simplest example of the meihod which is extended 
in two ways. First, A arid B, rh* premises of the rute, may themselves be consequences of 
Other facts and implied by Other rules. The explanation function for "A and B implies C* 
calk the explanation functions for these rules and so on. Eventually a. complete and 



detailed explanation of the Infertncing is produced. Stcond. each (>xplan^rivn function ir. a 
procedure and can eauly have idiosyncratic behaviour. One common addition is for a rule 
to state itself ai well as the particular Jflttanor, So we could have "Caves you have visited 
are Mf*. VdU have visited cave 3 SO it is safe", ft would be possible by keeping a simple 
record to have the rule printed nut with the instance Tor the first few times only. Qiher 
addition* make the English output flow better and, occasionally, context sensitive a speed 
can be added. The program will usually refer 10 & visited cave *S "«ve x which has been 
Visited" but became off context might say "cave X where you are now". Up to a poini. rh^se 
emlwltish merits are easily add*d and the advisor has many. A general purpose English 
output program must be the nem slep (see Slocum |gT?5i McDonald {forthcoming), Riesbcck 
1915). 

Since the expert program is modular and contains an executive, the explanation 
functions fall neatly into classes. Some explain About bats and pus fir about the Wumpus 
and some about the strategy as a ^bole 

[[ is easy to lee from [he example that the explanations become longwmdcd and 
detailed. To 40me extent their hierarchical nature eases this but It would be preferable for 
only the more relevant or important parts of the explanation to be given to the student so 
that he is not confused tjy too nyuch information. We could have included virloui *d hoc 
techniques for pruning explanations which would have been moderately satisfactory. It 
seems more sensible from a research standpoint to first improve the student model SO ihm 
there is a good basks for judgement! of relevancy. 



$. Fro g rain drF-ails 

i-\ Bats J ltd pits modules 

The bats and pits modulei of the expert embody about eight rulei of Inference and 

use them to determine the positions of bati and pits. They iff of two kinds, logical mips 
which tin be u«a to deduce the eaar.1 location of haiard*, and probabilistic rules which 
Can only estimate the likelihood of bats and pils In any particular cave. Kclti types of rule 
have already been diseased and here i*c describe them in detail. 
There arc four Hog teal rules For bats. 
1> A squeak heard in any cave implies thai (here \i a bat in at least on* neighbor of the 

caw, 

ti) Visiting a cave will tell you whether that cave contains > bat. 

c) If a cave does not iqueak Chert none of its neighbor S ran contain a bat. 

d) f f the total number of bats is glv^n, Ih-ej" can sometimes be located exa-Ctly 

Rules for pits are almost idenTHIal, the one difference being that rule b) H of little 
USft If you fail in a pit the game ii over whereas a bat may ikmply carry you to a tafe cave 
elsewhere. Rule d) is faLily complex: and I* not i mpkmented in our system. It works 
because If there are many more caves next to known squeak caves and only a few bail in 
the warren then only certain arrangements of bats will explain all the squeaks. The crucial 
point about rules a) b> and c) which a beginner may not immediately notice IS that b) and c} 
may rule out possibilities suggested by a) to leave only one. Tn this Case a bat or pit has 



b«fl exactly located. Knowing- rhe ncact location of a bat in iUch a manner can in turn 
allow the probability rules to explain 4Way certtm squeak & neighboring that bat. Th 
could lead Hit expert to conclude that certain caves are wfe, 
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figure 2. 



Consider tfie«ampfe in figure?. Cavej with circles around iheir number? have been 
vlilted; caves I, 9 and 4 arc known to squeak ■ eavej 2 and 7 are known not Co squeak. 
Brcaus* of the squeak at cave ], either cave 2, 3 Of S must conmn a bat by rule a| Din 2 
cannot by rule b) (it has been vkilrcd) and & unntrf because oF the lack of a suueak *< cave 
7 by rule cj. This leaves only ave 3 ju (hr bat cave BlK a bat at a ex plaint away ihe 
squeak at 4 so there ti no reason to suspect a bat at || or 5. 

To implement the rules we use candidate sets. Flatly, the state of the board as s*m 
by the prayer is represented In the data-base using the properties KNOVvN-Sr^jUEAK. 
KNpWN-NOT-SqtJEAK, VISITED. V-BAT and KNOWN NEIGHBORS V BAT 



means the cave has been visited and contains a bat which therefore tanned ihe player away 
before he saw the neighbors, of the cave. Nejtt a candidate !*t U generated far each squeak 
cave, duplicate sets being flushed. At least one bat must be in each candidate set. A unary 
Ca.rtdtda.te ief Is. added to account for each ■visited bat «ve, The Sets produced lO account 
for figure 2 would be 

(?S6> £3 IIS) (710) (10) 

Nex\t, rules b> and c} are applied to remove ■ravp? from candidate Sets We no*** 1 have 
the seti 

W {3 II ft) (10) 

Logically, in our example, we have deduced thai caves 3 and ID contain bats. If we 
knew th&T there were only wo bits in the warren, the unimplp.mented rule d) could be used 
to prove that LI and b are absolutely safe. 

At :his stage, the logical rules are exhausted and the probability rules lake orer. 
There are four probability rules, each corresponding tf> a fairly general rule for estimating 
likelihoods based on limited evldenw, The rufcs are qualitative versions erf the application 
of simple probability theory and Bales' rule. We will describe each one laying a few words. 
about its Implementation- The rulej are as follows. 



a) Equal livelihood 

b> Evidence an be explained, a*ay 

c) Multiple evidence can incms* probability 

d} Multiple evidence can decrease wnw probabilities 

Whenever (JtlCTly one of a set of equally likely outcomes must occur, simple 

probability says thai ihe total probability must be I and an estimate can be made of the 
probability of each outcome This rule applies approximately to any candidate set 
produced by the logical rules If [he scl has, N members (hen we may deduce that the 
probability of a bat being in any particular cave is UN We can compare the tafcly of 
alternative moves because caves in smaller candidate sete are more likely to contain biHS. 
This rule is approximate for two reasons. Firstly. !h«re may be two bits In any candidate 
Set although for a large warren anct few hajardi this is unlikely to make the rule 
inaccurate Secondly, knowledge about rhe remainder of the warren may influence the 
probability of i particular cave having a tat in subtle wayt 
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A particularly common way thai this second caw ariws is that a pfobabte or certain 
bat in one dVt explains away evidence that supports a bats being in 1hat cave Si well ii in 
several Others- This rule can be applied whenever nne r.indidjte set is a subset of another. 
Figure 3 shows a -taw vmh two candidate sets (I 2 3) and (I 2). The hat in (I 2) flu? to the 
squeaking explains away the squeaV at i that gave rise Id (1 2 3) and there is rm reason to 
believe a bat exists in 3. Evidence supporting 3 is explained away by the bat in (I £). Our 
currem advisor implements ihu by Tawing the probability for 1 to the livelihood that a 
bat was pot in 3 by the program which set up the board. 

2 e 




figure 4. 



If two candidate seu overlap we have a situation of multiple evidence. Figure 4 
shows 3 caw when* a *queafc at I gave rise to a candidate itf (2 5 4). and a squeak at 5 to a 
W* (4 6 T). A fell at 4 would explain all thii evidence. Alternatively, two pieces of evidence 
point to 4 but only one each to % 3, & and 7. We implement the rule for I his situation by 
considering the probability of no bat at 4. 

P(bat at 1) - 1 - P(no bat at i) 

- I ■ P(bat in (2 3)) • p(b&r in (& 7)) 

A general version of (he famuli can easily be derived from thj* 

This rule introduces a problem. II the probability of the common caw is increased 
[her the total probability for each candidate ifl is raised above 1.0 which violates our initial 
approximation of one danger per cave. The greater probability of tbete being a bat in the 
common area should partially eJtplaih away the evidence and reduce the probabilities for 
the other cases. Since the ciact Formula for fhis would be cumbersome our program uses a 
rough formula to average out the discrepancy by reducing all the probabj lines bv a little. 
This is the fourth rule. 
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Another problem arises when mOrt than one rule applies at once. Figure & shows two 
ClVes. I and ?. both squeak and are both neighbors of cave 3. If cave t is also neKt to a 
cave which ll known to contain a bat then its squeak, in totally explained away and gives no 
further information. It cannot be used in conjunction with cave 2 as a case of double 
evidence Cpr a bat Ln the cave connecting 1 and ?. This means, that we must apply the 
eiiplain-away rule before the double-evidence rule. Suth prioiily constraints, occur uhen in 
programming' so we should not be surprised when a student needs Co know them as part of 
the b(i own program for p(a)fi.ng a game well. 

The four rules give estimates that fit the intuitive judgements generally made by 
players. The advisor states the factors used in the evaluation and gives a rounded off 
version of the result of m own fotmubie It w*i unimportant for us that the student could 
precisely apply probability theory and We preferred that he be led towards making wcll- 
based estimates, The four rules we uie are suitable for this and are applicable m other 
domains. 

3.2 The Wumgns module 

More complex deductions can be made abnut the lntatinn of the Wumpus chan about 
bats and pits, Because a smell means that a Wumpus. H within two caves lather than in a 
neighboring one it is weaker evidence than a squeal or breeze and gives rise to a much 
larger candidate set of possible Wumpuj caves. On the other hand, absence of jmell rufci 
out more caves than would absence of the olhet types of evidence, Since jmell-gerterated 



candidate sets have a radius of two caves at is powlble that a neighbor of ihc smell cave is 
Jrvkited making the candidate set Lncomplel*. It is alio difficult (0 1*11 if moving from 
one smell cave to another takes ]fou closer, further auray or leaves you at the same distance 
from the WumpUS. A11 these factors lead to a more complex set o[ inference rules than we 
need for the bats modules 

There ire two simplifications which make (he problem tradable future pro^ijmj 
might cover the more general case and It would also be interesting to Vary the type of 
Wumpui evidence {intensity of the Smell with distance from [tie- Wumpus or number of 
Wumpl fur example) to see what rules would lh<rt be nreded The two simplifications we 
have made arc as follows. 

1} The expert only, makes logical deductions about the Wumpui and not probabilistic 

judgements. 
2) In the original game the Wumpus naj move when an arrow is fired which misses 

him. The Wumpui Is fitted in our version. 

We examine wayj to make probabilistic judgements about the Wumpui; liter, If the 
second simplification is relaxed and the WumpUS is allowed to move, older evidence would 
be ;te^Tftded but would nor ln:.p .ill rr^ vj| jc\ A smell :av* which 1 1 :■ ' u r ■? H ;hr- \,? i mi^li-d 
that the Wumpus wai wuh in two caves, would now mean he must now he within three. A 
fto-smell cave would now guarantee onlj (fat he I* not In one of the cave's neighbors. The 
tncrea.se in vaMrtf of evidence would make the rules more complex:. 



We use fi*c major Wumpus finding rules. Ea<:h U further away from the rules of 

play than the bats rules are and require! Some simple proof oF Jts correctness which 
naturally should play a part jn trie explanation of the rule given bv the advisor, The rules 
are methods for deciding one of five properties oF a cave namely , SAFE> TWO- A WAV, 
ONE- A WAY, WUMPUS. and MO RE-T HAN -ONE- AW AY. 

ftuTel: GOAL - To prove i ave is SAFE 
A cave is safe; 

a) iF it has been saFely visited 

b) If *n arrow has been Fired into the cave- and no Wumpus was. hit 
c> If there is a NO-SMELL cave within two caves uf it 

Thii rule 11 eaUty justified and Li invoked whenever one of the properties, VISITED, 

MISS, NO-SMELL is asserted about the-r^e in CfUestion. 

Rule 2 : GOAL - To prove a cave Is MORE-THAN-ONE-AWAY 

A cave is more-than-one-away from trie Wumpus; 

a) if we can prove It to he (wo-away 

b) if It doesn't smell 

c) If a neighboring cave does not smell 

a) ■! obvious and b) and c) are j^mple Hnc< iF a ca^e ?«ere the Wumpus or one away 



then all of Jti neighbor* would until. This rule ,* not exhaustive. T h Wf arc probably 
other wajfi to prove mme-than -me -awavness byr lis use ii limited to these ipecial case* at & 
http to liter rules. 

Rute_9: COAL - To prove a tiVe is TWO-AWAY 
A taye is two caves from the Wumpui; 

ij if it smelltand it fa more-than -one-awa f 

b) if it smells {so all the neighbors ate known) and none of the neighbor j n the 
Wumpus. 

Both parts of this rulP n«d commwl HuJn .1) depends nrr thr- ionr iguration shown 
In f Ipure 6. 

SHEU. NO-SHELL 




teve; 1 rwjst be. exactly tuo fron the Uumrjua, 
1 1 gur* S + 

Since cave l jmellt it is within (wo caves of the Wumpui and must be either on* 
l*o avti away But cave 2 must be mure than two cave* awaf and, as I and 2 are 
connected, the only coniUrent case Ii for cave I 10 be two away From the Wumpus. Both 



■■■ir 



cavei must be vfajted for thU rule to be applied And the rule i$ triggered whrn any £M ELL 
or NO -SMELL cave is discovered. 

Case b) succeeds by proving that the ca*r Li more-than -onea wa )f Trom the Wumpui. 
Since it smell*, it is either or>r of two away and » must be n™ away. Notice lhat rule 2 
does not help here. Instead. ** pro*e that no neighbor is the WumpUs cave m the cave (n 
question U more-than-onc-away ThiJ rule is triggered when any cave is ihown to be safe 
by nite I. All neighbors of the new safe cave are checked for smells mid any cave which 
dOH smell has. the ruie applied lo it. Alternatively, a new irnell cave may trtjrjcr the rule 
If either case of rule 3 succeeds It will trigger rule %. 

Rule* : COAL - To prove a cave is ONE- AW AY. 

A cave it one away from the Wumpm is it has a neighbor which is two aw^y and »V 
Other neighbors Of that cave are more-than-one-away. 




figure 7. 



Figure 7 shows an example in which cave 6 must b? on? away from the VVumpus. 
The reasoning is as follows, fly rule 5a), cave 2 d two iWay. But we know all its neighbors 
and one Of Lhcm must he one away. Cave 1 cannot be, by rube 2b), and since cave 5 Is two 
lway f b r rute $»)* ClVr 3 cannot be one away either by rule 2a). By process of elimination, 
this mwflj (hat care 6 must be one away. 

Notice thai rules 3b) and -|) Are similar to the bats and pits logical rules. Fhrst a 
candidate set li generated in which at le^sr on* element has a desired property Them all 
members are deleted and the remaining possibility becomes a certainty, This technique 
could he called "reasoning by elimination" En the bar& case the property was directly reFatcd 
lo the game rules whereas the Wumpus rules require some thought to discover relevant 
properties such aj ONE-AWAY. It would be interesting to see 1f w; could design an 
advisor that would lead a student to develop these Wumpus rules from the twes rules and 
to realise that reasoning by default is a commonly Useful method worth identifying and 
naming. We leave It to the reader to Jee how (he method generalises to give rules for 
detecting Wumpi who smell more and can he detected from greater distances. Rule *> also 
uses reasoning by elimination 

Ru]e_& GOAL - To prove a cave contains the Wumpus, 

A cave must contain the Wumpus if it has a neighbor which is one away from the 
Wumpus and all others neighbors of that csve are safe. 

We can sec an cuample of rule 5 in figure 8 r an eilenuon of figure 7. Suppose the 



player visited cave 6 and discovered It smiled Jnd connected with 3 and 10. Since 6 is one 
away and neither 2 nor 3 Li the Wuropui h? rule Sv cave ID musi be the Wumpus. 
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figure 1 ft. 

3.3 General comments on rhc Wumpiiis module 

Despite the ilmpll;f1«.tiQns we made,, the rules f or Wumpus hunting are still comples. 
There are common elements and the ruks inter-relate by triggering each Other at several 
paints. Nor are the rules complete. Wc could Use the fact that there is only one Wiumpu* 
to help locate him. Figure 9 Is an extension of figure 1 where we visit cave 6 and discover 
the new neighbor} *t and & Tbe Wumpus must be one of these. But t*e have only one 
arrow left and daren't waste it. So we visit CaVe 5 and discover neigbWs & and 9 We 
have two candidate sets for the one Wumpus, fjf S) and (6 9). He must be- at 3. 




figure 3, 

Such a, large body of knowledge mal,« advice giving a difficult problem. Our 
adviser applies the rules, dcSctLs any instance In which the student could have m&de a 
belter mo-Ve and prints out a protocol of" the rule's application This n&ive tutorial 
technique could be improved in several way*, Flrsr, car* neerti to be taYen over the 
distinction between a rule and its- instances. Our advisor follows the pa:a*Jigr" of teaching 
by example It should iIm teach by giving general explanations, Second, the rules inter- 
relate and it is non-trivial to organise them all 1c simplify their application ll H possible 
that a player knows all the rules but is muddled about :hc-ni in practice Thirdly, we build 
tiu model Of the Studehl's knowledge SO it Is Lmpoisibk to debug him when lie uses, an 
incorrect versiom of a rule. He may prove that a cave i$ iw& a*<ay by UHng rule 3a) but 
Then think that all smell caVes, next to it must be closer to the WumpLH and mult be one 
at way. We need a way to classify, detect and correct trmeerrori, 

Just as our expert could make qualitative judgements about the probability of bats 



and pits, Lt Is possible to Introduce rul« for judging (tie likely EocalLon of the Wumpus, 
There are two Ways Ed da this. We tan male use of the similarity between Wumpus 
hunting and bat finding where reasoning by elimination is used to set up candidate sets. 
A11 the probabilistic bar rules will (hen apply to the candidate sets. Rules ?&), + and 5 give 
rise ta candidate sets for the properties TWO-AWAY„ ONE-AWAV and WUMPUS 
respectively. There Is a transit I v key pbenonKnon too. Probability results from rules 3 and A 
an be Uied at evidence in rules 4 and 5 respectively Here I J possibly a general principle 
of plausible reasoning. An enact rule has. a probabilistic counterpart for use when 
Incomplete or uncertain evidence is fed into it, This would provide a nice basis For an 
advisor whose goal wis to teach plausible reasoning by weighing evidence. 

i (2 ' 




f i oure 19. 

A second totally different strategy for maUng probability judgments is possible and 
gives rise to further principles of plausible reasoning of very general application. Given a 
board stale such as that in figure 10, we can enumerate several hypotheses for Ihe location 
Of the WumpUS. Consider for eKannple caves I, 5 and 8. Each of these hypotheses will 



explain av/ay wmt of fh e evidence in the figure. None of the hypotheses is totally 
discounted out each require* a different set of extra properties to be true of. the hoard 
which are stilt to be tested. A Wumpus at 6 would explain all the smells and alio .he 
smdlftiMnidl pair it 3/». ft need* „ estra lhin g S t0 bi true Qf the board Hrporhesi51 ^ 
av* 5 however, doej not explain the smells at 2. 3 and 7. It thus n«ds extra hoard 
connections and th«e ma y or may not exist. Some measures of the evidence explained and 
the extra constraints Imposed on future discoveries tlh be used to compare rht livelihood .5 
or various hypotheses. Both measure* are needed. Constraint measures an be used to 
compare hypotheses ind the explanation measure provides some absolute measure of 
confidence. 

8 i.4 The executive's move classification 

The bats, pits and WuTnpus experts are used to determine the probabilities of 
meeting a hazard in any particular cave. This information must be used by the executive 
to evaluate a move. The executive forms the strategy component of a Wurnpus player but 
since the game requires little lookahead, planning strategies are hardly needed. Each move 
an be evaluated on the basis of the current state and the affable alternative moves Two 
strategies exist and a players behaviour can follow either or hoth for several moves even 
though he makes all his decisions move by iwie The strategies are called "playing safe" 
and "gaining information*. Wasting time « n be thought of IS a third hut is a degenerate 
case of the first and the advisor deals with It impatiently. 

Playing saFe mean* making the safest move you can find. Clearly the Safety of a 



cave depends an the probability of Jt containing a haiard and [his is reported on by the 
respective experts. Fits and the Wumpus mean certain death so t h-py are easy to deal with. 
They ar* Independent and their JOi^r probabilities fur any cave can be computed. A bat 
may be relatively safe since it does nat necessarily leave the ptayer in a deadly cave 1 . The 
executive estimates the danger by using a simple formula which we will derive If the 
number of caves a M. the number of bats b, and (he number of pits p h then if we assume 
that no rave contains more than one haiard (a good Approximation if N is much larger 
than p and b) we can reason at follows. 

P(dcath by bat) 

«Pf,ynu land on a pit) 

*P(ycU land on the Wumpus} 
*P(you land on a bat)«P(death by bat) 

Pfdealh by bat) - deadly caveifnon bit caves - (p*r),f(N-b) 

ThLs worts because after being dropped by a bat in * bat cave again the chances of 
death are the same as they wete Ml first moving into a bat cave, Another way of chinking 
of this wquld be to sum an infinite series with a term for each total number of bats it is 
possible to land Oil ih one move. A third way is to realise that the process of being moved 
about by bMi must eventually stop In i non-bat cavr and Chc-rc is no reason to prefer one 
aver *nyr Other so the chances are equally likely 



We explained the derivation of this Tornula in such derail hecauje it I S *ft 
opportunity to consider The amount of knowledge about the application of probability that 
a perfect advisor might nepd to explain The moral is cautionary. In practice our 
executive simply evaluates the formula and states the M eIi hood nf death a i >~* patT of H4 
explanation of the darker in a cave, The Student i! tk peeled to come to some similar 
decision qualitatively and to improve his reasoning '.n he coincident with the advisor's. 

Shooting arrows is also a tricky type of move to evaluate. Our executive only deals 
with this in sp«Lal cases when the Wumpus is either located or known n> he in i* diffeiertl 
direction from the shot. A true estimate of the risk involved should Include (he probability 
of hitting the Wu.mpus since arrows can only be dangerous when they miss. 

The second strategy for play IS to gain Inftirinatian. Again, a move which has been 
made before gains nothing and the strategy degenerates into time-wasting Information can 
be gathered in two mam ways. Moving to a new cave gives information about the warren 
and perhaps also about bats and pit! However, new information about bats and pits can 
hardly be predicted. If a cave is suspected of being a bat or a plt h discover he; that it is not 
ctrtild allow Inferences tp. be drawn about the actual location Of the hazard In Wampus, 
examinations in such detail are not very significant but it n easy 10 Imagine real-world 
Situations where a rist is worth taking for the negative Information that may hr obtained 
A naive Wumpus player may rush into dangers for this reason and the advisor will caution 
him, Since Wumpi can be smelled from two caves away and as certain caves can be 
deduced CO be two away Jt is possible and often safe to move Into a cave I hat has a good 
chance of giving information aboil! the Wumpujl. Again, the true value of the information 



can Ohty be gauged by considering th* inferences it would allow, Foe our purposes ive 
limply dtitingu ish between 'pouible'' information gain and "fifotoble" gain. 

The two strategies Interact JO that a decision theoTy model is. needed to compare 
accurately the information gained with the risk Involved Slut* the Version of Wumpus w« 
UJ* place* no time constraints on the player, our advisor makes safe play more important 
than informative play Before describing the mechanism for ibis, consider the following 
example of a case of complex evaluation, tn (he beginning of the game it may he uwful to 
take a bat to reach new parts of the warren. «pfcially if all other moves in the locality are 
dangerous. There are relatively few pit* m.i j; | 3 unlikely that death will ermif, Later in the 
game the s-ajTety of a bal is unchanged. At this Stage, most of the warren might have been 
investigated, in which case the Information value or taking a bai is lowered considerably. It 
may no longer be worth the risk. It is possible for the player to be completely trapped! so he 
can only make deadly moves Of repeat bis old ones. In this case ibe value of laling a bat is. 
that it might drop ytW in a new situation even if chU had been visited earlier. A decision 
theory and planning theory of Wumpus could in future be the basis of an advisor for this 
level of play. 
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figure 1L, 



FLgUre tl shows the move classlf tcation scheme used by the current executive to 
capture th* two strategies. Firing arrows and using bats to gain information have been 
esclurierf f mm (bt evaluation. Safely is. factored into safety from tuts and pits, and Safety 
from the Wumpus. There arr seven classes of move excluding repeal moves and they are 
numbered roughly in order ai gpodneu Th< itv^n tin be divided into groups of three, 
three and CM. The first three are totally safe fTom pats and. pits as proved by the experts. 
Types 1, S and. 6 are unsafe according to bats and pits and type 1 is certain d«th. The two 
groups of three are similarly organised according to WtirtipUE conditions. Best of .ill \xp 
moves known to be .Sift but next to- smells and therefore lile|y to Teveal information about 
The WufflpuS. Second art those caves which, are safe from the Wumpus but unlikely to 
give information about it. Finally, we have the cave* which at* unsafe from the Wumpus 
and therefore likely to give information about it. Each move type 4, 5 and G can be further 
ranked according to the actual degree of bat and pit urisafcricss. 

The classification is effective and to some extent distinguishes the Strategies and 
places them Jn order of safety. It also clarifies the advice-giving' role of the executive for 
as, we shall describe, each move type has a corresponding analyst wrath specialises in 
advising about moves of that type. 

There ire. difficulties In capturing the interplay beiwetn strategics Ln a classification 
scheme. Consider move types 3 and 4, Both provide the same kind of Information so their 
ranging C*n only be- determined for particular moves by the relative dangers involved 
Again, Classes 4 and. 6 give the same In f&rmj tidn and under certain conditions each could 



be better than (he other. A better viewpoint is to consider decisionmaking under 
dangerous condition* tobtl decision theory prnbfem. The expert should be able to 
compare rislts and profits and Jts. explanations should be in these term* 

j .5 The flow of control 

figure 12 Shows a simplified flowchart for the system Whenever the program 
request) a move, control ti It point A at the head of trw flowchart. Certain special case 

such as sh-DOting and requests for help are dealt with by special program*. Otherwise The 
expert 11 called to classify all prmible moves, in particular the one the player actually 
wanted tq make r and control IS Switched to An appropriate analyst for the player's move 
type. Analysts consider the available moves to decide if the player made a good move. If 
he did it allows him to go ahead but Otherwise |t explains why the move w Ri bad. parcly 
using jtj own explanation function! and partly using those aasotrated with the individual 
Specialists for bats, pits and ;he Wumpus, 

The player Is always allowed the option of preceding but if he wishes to change his 
move he n offered advice. When accepted, (hi J takes the form of a good move and an 
explanation of the benefits of thiJ mute over the player's. 
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Figure IS show* the schema for move-IJ/pe analysts. It is self -ex plana tory except for a 
few poinds. IF two moves are dF the same type the) map Or may not be of sufficiently 
different quality to Invoke advice-giving. Since move-types +, $ and 6 have a range of 
safety from to [, one move can be very safe while another of the same tliiS it very ntky 
Second, the explanation function! are context sensitive. A move which is dangerous b«h 
because of the Wumpus and pits would not always give rise to an explanation of the 
Wumpus danger. If no available move was safe from the Wumuus the advisor gives the 
player the benefit Of the doubt and assumes he has seen this. It assumes he those the 
wrong ~„v,.e because he omitted to take proper account of (he difference in pit safety. 
These; assumptions are a recent addition to the advisor and we only discovered rhe need for 
them by using the program, It is remarkable how interaction with a program reveals 
glaring design ommisions which would Otherwise be unnoticed. 

Together the specialist modules for ba!s, pits and the Wumpus. the executive and the 
advice-^ivLng components of each make up the majority of the ad^uor- 



♦- A decision theory jpor oacli. 

The *Jt«yfj V * module of the wumpus « prrt reprints various types of danger and 
the way* information can be gathered by means of a note. i n effect. a] | the decisions about 
mde-orn between rtsi«*„d gains are compiled. This mrthn d „ restrictive atid son W 
Jubtlettes of the trade off a T e omitted We now de*rita . more umform and general W *y 
Of dealing with such declitons that wilt be suitable for Art improved version Of the advisor 
It Li based on dedikH, theory which is «pecl*N r designed to represent probes of choke 
in uncertain Situation* like Wulhjnii. The anal^s of a proWftl1 usirig dedlkm c ^ ory h „ 
three components. 

3. A d ecision tree. 

Thii it a tree of states of the world rather like a lookahrad tree for gam* theory or 
planning. It Is rooted at the initial slate and at each Slale the player is given a set of 
alternate actions from which he may chose one In Wympus a state represents the pouter, 
at a point in ptay and the choices faring the player ire his legal mnves, For any move th* 
player makes, the world can respond in a variety of ^ ,„<! « c h hai an associated 
probability of MUring. If the player moves into a risky cave then zwu possible outcome* 
•re that the ca* e actual?), contains the danger or that it does not A more detailed 
d«cfiptipn of the outcomes might specify the possible new neighbors tbat might be 
discovered. A decision tree (tin; ha- two types of arc. those Correspond,^ to the pl^rs 
chokes and those that correspond to the hrarldt The only difference from a game Iree Is 



the special way (has the player's opponent be-haves, Tn gime tlienry he trie* to make the 

belt move whereas In decision theory he behaves according to probabilities thai can be 

estimated. 

^An evaluation function for terminal nodet of the decision tree, 

The terminal nodes of the decision tree have values for the decision -maker which 
can be evaluated if some procedure for doing so is specified. This procedure must take 
into account ad of the good points of being at that state and weigh them against all of the 
bad points, ft calculates trade-offs. The mnjt common method is to measure each cost or 
gain with a single number and to combine these by simple linear weighting. The value of 
each feature is multiplied by a weighting factor and totalled with the others. If a feature is 
very good or very bad then it has a larger weighting factor either positively or negatively. 
3- A back-up Function- 

Given a tree of possibilities and values, for each of the terminal nodes it remains only 
to decide on the best action to take at the initial state. It is possible to work out what 
expected utility each action has by working bacYwardi from the terminal values. Suppose 
we have a state which allows several actions each of which has several outcomes all of 
which are terminal. We know [he probability of each outcome for a given action and we 
know their values since they; are terminal. The expected utility for that action is easy to 
evaluate using simple prohahdHly theory. Wbkh action Should we choose? Cle*Tly rhr on* 
with the highest enpected utility. This means, that the espetted utility for ihe state is the 
highest of the expected utilities of the actions available at that slate. Now the state can be 
considered a terminal state since it has been valued and we can continue backing up the 



tree until we tfete rmihe which action to take Fjotti pur starting date. 

This approach to Ihe analysts of 1 decision problem assumes that the value of a stale 
can be determined from the values oF Us component features Four of these components 
clearly occur in Wilmpus. 

L,Risfc of death 

The Utility of dying should be very large and negative. It cannot be nrmuu inFmity 
since this would multiply bjf any probability of death to be mmui infinity. Instead, utilihei 
could be a function of the probability i>f >imh [ her* are v;ulousways that death can 
occur, railing into a pit, wandering into the Wumpui, shOOLing- your&eir with an .irn.>w r or 
being Carried away by a bat into a dangerous, plate These- possibility? reveal Lhemselvcs in 
the decision tree. If a student fails to account for any of them it is teflected in his. 
incomplete decision tree. The probabilities of several of theje cases are quite tricky 10 deal 
with 
Z Information gain 

The amount and v*lue of information gained by arty move are Imponant. The 
value depends on what is already kno*n as new facts may allow important inferences. 
Information may be gained about the barren itself and about the dangers in it. In 
variations of the fame where (he Wumpus may move H it possible to lose information, 
Inferences must be dealt with by a s*t of logical atid probabilistic rules such as we have in 
the existing advisor. 



3. Coal 

The ulriinaTe goal of th* game Jj obviously an important con sld era! rem in deciding 
upon: the value oF a itate. It is not sufficient 10 nuke safe move? or to f md nut 
Information It li ab« important to V ill the Wurnpus. Killing the Wurnpus must thus nave 
a high positive value. A small chance of killing ir may be better than * large chance oF 
gaining information. 1ft variations of th* game IT would be posuhle in injure the Wurnpus 
perhaps slowing him down if he can move around the warren. 
i. Resources 

A very important value In real-world situations Ji the value of resource? This was, 
after all one of the msift reasons fOf Inventing money. The only resource used in our 
current version oF thr game is a supply of Arrows. Tt ii clearly very idly so tafce a chance 
w<Th your latt arrow though It mny be worthwhile testing hypothetical Wurnpus locations 
wiLh the first few. Many other resource types could be added to the game, time constraints, 
being one of the more general Given a Fixed time tg play before the warren falls in on 
you will affect your play, It would become had play to waste time. A more interesting way 
to introduce time is to make the WumpUs actively took for the player, eating- htm when ir 
finds him. Thii could hecome a two player game with the advisor watching or else the 
advisor could he one oF the players. 

From the dlKUSSiufii Of each of these comoonenti Jt Is easily seen that Wurnpus can 
have many interesting variations and all of the variations will eauly fit into the framework 
Of decision theory. A newer advisor based on Such an approach would be ililn ti ,irtvi<.e n 



rner afc, out P'ayJng *H the different variations. So far our goal for the advisor has oeen to 
introduce people to a situation in which the implications or a few logical rule* are 
important for sensible decision making. In particular we chose a situation u-htch had 
uncertain information This naturally leads to the extension oF teaching decision theory 
When we consider this we discover at least Six types of bug a Student may have which 
directly concern decision theory some of which were out of the JCGpe of our current advisor. 

1. Failure to judge prob a bilities. 

Failure to determine the likelihoods of the various outcomes of an action wp(1 cause 
errors when trying lo back Up the decision tree. 
SjM£J>r Ojjrlale utility functions. 

The Student may have Utility functions which are inappropiiale for winning the 
game. He may IhinV that pits are less dangerous than the Wumpus ror *!L.am F iV Or he 
may be playing the game amending to a strategy which requires a different set of utility 
functions. He may wish to fall into pilS to help him remember (he result of Such an action 
Of 10 Check his hypothesis about what will happen. He might also be more interested in 
playing for fun than playing efficiently. An advisor that could recognise and relate (o ibis 
would need to take a&ccHim of the player's values accordingly 
^Failure to Ste all the alternatives 

Expreued in the decision theory paradigm this bug correspond? |y * n incomplete 
procedure' for generating a decision tree. 



A. Refusal Lo cut losses, 

ThJi does net occur in Wumpus because there are no long term plans involved. It Is 
however a common bug which manifests itself in a distorted set of values Pa it losses are 
weighted too heavily and act Jem art taken which have only a small probability of 
annulling them. 

5. Myopia. 

A decision tree, which is n« deep enough will give Hie to short-sightedness. SmalV 
immediate gains wtll be prefer red to long-term ones. Large long -term losses will nor even 
be considered. 

6. Preo cc upation with details. 

This ii related to the myopia bug bin instead of the tree being too shallow it is one- 
sided. All the planning resources arc used to plan ahead on only a few paths. The result is 
that when a move ii eventually made it is either on the wrong "truV or bawd U p n too 
shallow an investigation. 

■ 

Wumpus has very simple- strategies for play and though this was one reason for its 
choice il is perhaps time to consider what additional properties we would like a fame to 
have for our advisor to teach in an interesting way. The simplicity of Wumpus largely 
arises because all decision making for a move can be done at the time of the move with 
only the information available at that time. Each -move is made separately Unlike the?*, 
the player does not need to maVe up strategies which govern the style of his play for a 
sequence of movei, Nor are there ploys and trick methods which help read an opponent 



Into an error. In short the Wurnpus esrpert raefds lo do no planning ahead more than one 
move. The banc cyefe of play is (o make inferences from current knowledge about ihe 
current state of she board, pinpoint the dangers, choose a move to avoid these d&ngers, 
malt* [he rr»ve h [hereof gain informjition and finally go to thf beginning oF the cycle. 

A more advanced game Would combine incomplete inFormatinn W(th nerd for 
planning. Look-ahead would be necessary along Sequences or actions each of which might 
have- an uncertain outcome. There should be different methods or play i hat are applicable 
in different situations. Since evidence gathering it as important as evidence we j^ hi og-, the 
game situation should allow the player to design a set of methods or strategics for gaining: 
information. Action in an uncertain sjtuailon is 1 feedback loop. Evidence is gathered and 
weighed *nd plans, are made both for acting and For gaming new iniormatjorc. Th* plans, 
may be bas«J on hypotheses, and information gathering should bf designed to test theje 
hypotheses as well as possible. One possible candidate for a game' is the gam* T2hie n . A 
murder has been committed and eich player tries to play the part oF a detective And 
dlKOVer three piece* of In formation, the weapon, the place and (he culprit. Each player 
has Certain information and by combining eveiynnei it would be clear what the -answer was. 
A player may only get a limited amount nf information from another at any one ttme. He 
thus has to make up strategics to determine the information he requests. Other players 
hear every player's, request but do not know the implications of rhe answer fully. Players 
have to move around a board to particular locations. before they can ask particular 
question; so an extra cost is Involved and Cflher players may be able to Infer things from 
this behaviour. 



Whatever game II Chosen it will be necessary to combine planning with decision 
Iheor y. Feldman {IWb) has shown how (his can be done. The principle (s easy 10 describe. 
A decision tree is effectively a planning tret showing all the possible plans. The results of 
PCttom In these plans are uncertain but provision Js made for each possible outcome 
Instead of looking fot the UlrFily of a Terminal state snd moving so as <o increase your 
expectation of this value, all the steps oF the plan have to be taken into account. Each slep 
has costs and gains associated w«h IE and Ihey must be idd«J Up to determine the value of 
the plan as a whole, T^n-h the plans can be compared and the best one ia>en An 
Important feature of planning in an uncertain situauon is that plans must he revised After 
■each Hep II executed since new Information ma/ change the sMuation-. 

Summing up, |r seems that decision theory provides a rich framework for 
improvements in the WumpLK advisor. In parlkular, the problems associated with making 
complex decisions involving canflKtf of goal, limited resource*, *nd uncertain information 
WFtK In a form which can he iaught usefully by an advising program. These problems 
confront people often- in everyday life when they Interact with other* and when Lhey try to 
mate plans for the future. Although an advising program written at this earty stage will 
net teach them how to cope with more than a toy situation, it is a step lowArds a deeper 
understanding of teaching in this area. 
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